Streaming Architecture: New Designs Using Apache Kafka and MapR Streams by Ted Dunning & Ellen Friedman

Author:Ted Dunning & Ellen Friedman [Dunning, Ted]
Language: eng
Format: azw3
Publisher: O'Reilly Media
Published: 2016-05-10T04:00:00+00:00

Setting the expectation that messages would be persisted for days or even weeks.

This eliminated the requirement to track when readers have finished with particular messages by allowing the retention time to be set so long that readers are almost certain to be finished with messages before they are deleted.

Requiring consumers to manage the offset of the next message that they will process.

While the actual offsets for committed messages are stored by Kafka (using Apache Zookeeper), offsets for independent consumers are independent. Applications can even manage their offsets outside of Kafka entirely.

Download

Copyright Disclaimer:
This site does not store any files on its server. We only index and link to content provided by other sites. Please contact the content providers to delete copyright contents if any and email us, we'll remove relevant links or contents immediately.